Baseten has built the world's fastest API for GLM-5.2, achieving over 280 tokens per second as measured by Artificial Analysis. The performance is driven by optimizations including an updated inferenc…
NVIDIA announced that its full-stack inference and training optimizations, including the GB200 NVL72 rack-scale system and NVIDIA Dynamo software, can maximize AI factory energy efficiency, reducing t…
NVIDIA released DynoSim, a workload-driven discrete-event simulation of the Dynamo serving stack, to model the complex interactions between LLM serving components. The Rust-based simulator runs 1,500x…
Cedana, a Y Combinator-backed startup from the S23 batch, is hiring a Forward Deployed Engineer to help maximize AI and HPC cluster utilization through automated GPU checkpointing and live migration. …
At the Google I/O conference, NVIDIA and Google Cloud announced new resources for their joint developer community of over 100,000 members, including learning paths for JAX on NVIDIA GPUs and an NVIDIA…